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CHAPTER  1 
INTRODUCTION 

Small  time-delays  are  usually  expected  to  occur  in  systems  due 
to  several  reasons,  among  which  are  the  effect  of  mass  and/or  energy 
transport  and  the  finite  measuring  time  of  the  system  outputs.  These 
delays  are  very  often  neglected.  However,  they  might  cause  significant 
deviation  from  the  nominal  system  trajectory.  Optimal  systems  with  a  delay 
have  been  studied  by  several  authors.  Chyung  and  Lee  [2]  obtained  necessary 
and  sufficient  conditions  of  optimality  and  dealt  with  the  questions  of 
existence  and  uniqueness  of  the  optimal  control.  Sannuti  and  Reddy  [10] 
dealt  with  the  problem  by  constructing  an  asymptotic  power  series  solution 

I 

in  terms  of  time  delay.  That  asymptotic  approximation  procedure  was  aimed 
at  improving  a  'nominal  design'  in  which  the  small  time  delay  is  neglected. 
Mee  [8]  proposed  a  design  method  which  calculates  optimal  linear  feedback 
laws  for  the  system,  but  ensures  that  the  effect  of  control  delays  is  kept 
small  in  closed  loop.  Inoue  and  Akashi  [1]  presented  a  synthesis  method  of 
a  suboptimal  control  for  a  regulator  problem,  in  which  the  optimal  control 
is  expanded  into  MacLaurin  series  in  terms  of  the  delay  time  and  the  first 
two  or  more  terms  are  used  to  yield  a  suboptimal  control.  Kleinman  [24] 
investigated  systems  with  observation  noise  and  showed  that  the  optimal 
control  for  such  systems  can  be  generated  by  the  cascade  combination  of  a 
Kalman  filter  and  a  least  mean  squared  predictor. 

In  this  thesis  we  are  concerned  with  the  design  of  optimal  control 
systems  in  a  manner  that  makes  their  trajectories  insensitive  to  small-time 
delays.  The  design  strategy  proposed  here  is  to  augment  a  standard 
quadratic  performance  index  with  a  term  of  sensitivity  measure.  For  deter¬ 
ministic  systems,  the  minimization  process  is  carried  out  using  the  well- 


known  Minimum  Principle.  This  method  was  proposed  by  Stavroulakis  and 
Sarachik  [3] ,  and  extended  to  Discrete-time  Systems  by  Cruz  and  Sawan  [19] . 
Subbayyan  and  Varthilingam  [20]  reconsidered  the  same  problem  apparently 
without  knowing  about  the  work  of  Stavroulakis  and  Sarachik  [3] .  For 
stochastic  systems,  the  minimization  process  of  the  augmented  performance 
index  is  carried  out  by  transforming  the  problem  into  an  equivalent  static 
minimization  problem  [22] .  To  apply  the  above  methods  to  our  problem  of 

interest;  sensitivity  to  small  time-delays,  we  use  the  notation  of  a 
sensitivity  function  introduced  by  tnoue,  Akashi,  Ogino  and  Sawaragi  [1]. 

Several  cases  are  considered  in  this  thesis.  The  delay  is 
assumed  to  occur  either  in  the  plant  (Chapters  3  and  5),  or  in  the  feedback 
path  (Chapters  4  and  6).  Several  system  structures  are  discussed.  For 
each  case,  both  stochastic  and  deterministic  systems  are  studied.  The 
proposed  design  strategy  is  applied  to  a  practical  example.  The  numerical 
results  are  analyzed  and  encouraging  conclusions  are  obtained. 
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CHAPTER  2 


PROBLEM  FORMULATION  AND  METHODS  OF  ATTACK 


2.1.  Deterministic  Systems 

Systems  considered  in  this  thesis  are  of  linear  dynamics  with 
feedback  control.  We  consider  the  cases  of  state  feedback  and  output 
feedback,  as  well  as  the  case  where  state  reconstruction  is  used.  In  the 
latter  case  we  may  use  a  full -order  observer  to  reconstruct  all  the 
states,  or  a  reduced-order  observer  to  reconstruct  the  unmeasurable  states 
only.  The  state  equation  is  of  the  form 


x(t)  =  A  x(t)  +  C  u(t) 
with  x(0)  =  x 


(2.1) 


where  x(t)  €Rn,  u(t)  €Rm  and  A  and  C  are  matrices  of  appropriate  dimensions 
The  output  equation  is 


y(t)  =  E  x(t) 


(2.2) 


where  y(t)  €r  and  E  is  a  matrix  of  appropriate  dimensions.  The  observer 


dynamic  equation,  if  used  is  assumed  to  be  of  the  form 


z (t)  =  F  z(t)  +  G  y(t) 


(2.3) 


with  z(0)  =  z 


where  z(t)  €r  ,  k  ^  n  and  F  and  G  are  matrices  of  appropriate  dimensions. 


We  may  have  a  state  feedback  control  of  the  form 
u (t )  =  D  x(t) , 

an  output  feedback  control  of  the  form 


(2.4) 


u ( t )  =  D  y (t) 


(2.5) 
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or,  if  an  observer  is  used,  a  feedback  control  of  the  form 

u(t)  =  D  z(t)  +  K  y(t)  (2.6) 

where  D  and  K  are  matrices  of  appropriate  dimensions. 

We  will  consider  the  different  possibilities  of  occurrence  of 
a  delay  in  the  system.  If  a  delay,  u.,  is  expected  to  occur  in  the 
plant,  the  state  equation  will  be  of  the  form 

x(t)  =  A  x(t)  +  B  x(t-g.)  +  C  u(t)  (2.7) 

with  x(0)  =  Xq 

along  with  the  control  law  (2.4),  (2.5),  or  (2.6).  If  a  delay,  u,  is 
expected  to  occur  in  the  feedback  path,  it  will  appear  in  the  control  law 
(2.4),  (2.5),  or  (2.6)  with  the  state  equation  (2.1)  unchanged.  If  we 
have  all  the  states  available,  we  will  use  a  state  feedback  control  of 
the  form 

u (t )  =  D  x(t-p.)  (2  -8) 

If  we  have  an  output  feedback  control,  we  will  use  a  control  law  of  the 
form 

u (t )  =  D  E  x(t-u)  (2.9) 

If  an  observer  is  used,  one  of  the  following  control  laws  will  be  applied: 

u (t )  =  D  z(t-u)  +  K  y(t)  (2.10) 

u ( t )  =  D  z(t)  +  KEx(t-u)  (2.11) 

It  should  be  noted  that  the  control  law  (2.10)  is  not  as  likely  to  be 
expected  as  (2.11)  since  the  observer  is  constructed  on  the  control 
side.  The  purpose  of  considering  that  case  is  to  cover  all  the 
possibilities  of  delay  occurrence. 


The  problem  under  consideration  is  to  design  a  system  with  zero 
time  delay,  which  we  will  refer  to  as  the  nominal  design,  such  that  a 
quadratic  performance  index  is  minimized  and  sensitivity  to  small  time 
delays  is  reduced.  In  other  words,  we  require  the  trajectories  of  the  system 
with  the  occurrence  of  a  small  time  delay,  as  described  above,  to  be  as  close 
as  possible  to  the  nominal  trajectories,  i.e.  thos  of  the  system  when  the  time 
delay  is  zero. 

The  standard  linear  regulator  problem  is  to  minimize  a  quadratic 
performance  index  of  the  form: 

03 

J  =  j  j*  (x'Qx  +  u'Ru)dt  (2.12) 

o 

where  Q20  and  R>0  are  matrices  of  appropriate  dimensions,  for  y  =  0.  But  if 
the  actual  system  has  some  delay,  due  to  some  of  the  reasons  discussed  in 
the  Introduction,  and  we  use  the  standard  problem  solution,  then  the  actual 
trajectories  may  be  unacceptable  compared  to  the  nominal  ones,  obtained  for 
zero  delays.  Reducing  this  sensitivity  to  small  time  delays  may  be  achieved 
by  trying  to  adjust  Q  and  R  in  the  standard  linear  regulator  problem.  For 
example  decreasing  R  will  result  in  a  larger  control  which  usually  yields 
low  sensitivity.  However  this  approach  is  not  convenient  because  it  has  no 
direct  theoretical  basis  and  it  does  not  have  a  direct  handle  on  the  sensi¬ 
tivity  of  the  different  trajectories.  In  other  words  there  is  no  systematic 
way  to  reduce  the  sensitivity  of  a  particular  trajectory  of  the  system.  All 
that  can  be  done  is  to  keep  trying  some  different  values  of  Q  and  R  and 
observing  the  trajectories  in  each  case  to  examine  their  sensitivity.  In  order 
to  have  a  direct  handle  on  sensitivity,  we  ought  to  define  some  sensitivity 
measure  and  incorporate  it  in  the  performance  index  to  be  minimized. 
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For  our  problem,  sensitivity  reduction  can  be  achieved  by  defining 
the  trajectory  sensitivity  function  [1]  as  being  the  first  partial  derivative 
of  the  state  vector  with  respect  to  the  delay,  evaluated  at  the  nominal  value 


of  the  delay,  i.e.  zero.  Using  the  notation  introduced  above,  we  write 


tj  (t) 

x 


Sx(t,p.) 

S'*  u«0 


(2.13) 


where  a  (t)  €Rn  and  a  (0)  =  0.  To  reduce  the  sensitivity  with  respect 
X  x 

to  the  delay,  u,  the  sensitivity  function,  defined  by  (2.13)-,  is  included 
in  the  performance  index  to  be  minimized  with  a  suitable 

weighting  matrix,  S  ^0,  of  appropriate  dimensions.  The  augmented  performance 

index  to  be  minimized  is  of  the  form 

00 

j  (x'Qx  +  u’Ru  +  a’So  )dt]  (2.14) 

where  El*}  denotes  the  expected  value  over  the  initial  condition  x^.  This 
averaging  process  is  required  to  avoid  the  dependence  of  the  necessary 
conditions  to  be  derived  on  the  initial  condition  xQ.  Q,R  and  S  are  design 
parameters  to  be  adjusted  to  get  a  desirable  behavior.  It  is  noted  that  the 
choice  of  S  with  specific  weighting  is  reflected  directly  on  the  sensitivity 
of  the  different  state  trajectories.  This  direct  handle  of  S  on  sensitivity 
will  be  investigated  in  the  examples  presented  in  Chapter  7.  It  is  noted  that 
<7z(t)>  if  an  observer  is  used,  is  not  introduced  in  the  performance  index, 

J,  because  what  we  practically  care  for  is  the  plant  trajectory  x(t). 

Now  we  present  a  brief  description  of  the  minimization  process 
which  will  be  carried  out  to  derive  the  necessary  conditions  for  J,  given 
by  (2.14),  to  be  minimal  subject  to  a  control  law  of  one  of  the  forms 
described  above.  The  procedure  consists  of  the  following  steps: 
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1.  Obtain  the  dynamic  equation  of  the  closed  loop  sensitivity  functions 

a  (t)  and  cr  (t),  in  case  of  using  an  observer,  by  calculating  the 
X  z 

first  partial  derivative  of  the  state  equation  (2.1),  (2.7)  and  (2.3) 
after  applying  the  proper  control  law.  Then  substitute  with  the 
nominal  value  of  the  delay,  i.e.  zero,  in  all  the  equations. 

2.  Form  the  Hamiltonian,  after  applying  the  proper  control  law,  as  follows: 

H  -  x'Qx  +  u'Ru  +  cr'  S  cr  +  X  x  +  X  a  (2.15) 

XXX  C  X 

X 

or,  if  an  observer  is  used, 

H  *  x'Qx  +  u'Ru  +  o'  S  a  +  X  x  +  X  cr 

xxx  cr  x 

x 

+  X  z  +  X.  ct  (2. 16) 

z  a  z 

z 

X  ,  X^,  ,  X^  and  X  are  appropriate  Lagrange  multipliers  and  are 
x  x  z 

assumed  to  have  the  following  relations: 


X  -  K,  .x  +  K.-ar 
x  11  12  x 


(2.17a) 


V  "  *21*  +  hlh 

X 


(2.17b) 


or,  if  an  observer  is  used, 

+  K12z  +  K13°*  +  k1403 

X3  ’  hi*  +  hi*  +  hfx  +  hSz 
\  ‘  hi*  +  hi*  +  K33ax  +  K34*z 


\  -  K..x  +  K.0z  +  K._cr  +  K.  .O’ 

a  41  42  43  x  44  z 

z 


(2 . 18a) 


(2 . 18b) 


(2.18c) 


(2 . 18d) 


where  K^;  i,  j=l,  2,  3,  4  are  constant  matrices  of  appropriate 


dimensions . 


s 


3.  Apply  the  minimum  principle: 


X 

x 


.  as 

3x 


(2.19a) 

(2.19b) 

(2.19c) 
(2 . 19d) 


4.  Equate  X  ,  X  ,  X  and  X  evaluated  in  (2.19a-d)  to  the  corresponding 

x  z 

values  obtained  by  differentiating  (2.18a-d)  or  (2.17a-b).  Hence  get 
equations  for  K^;  i,  j*l,  2,  3,  4.  It  will  be  seen  that  such 
equations  are  linear  algebraic  of  the  Lyapunov  form. 

5.  The  optimal  feedback  gain  matrices  satisfy  the  following  necessary 
conditions : 

CO 

0  -  E{  J  ~  dt}  (2.20a) 

X  3D 


0  -  E(  f  H  dtl  (2.20b) 

o 

where  E{’}  denotes  the  expected  value  over  the  initial  condition  xq. 

It  will  be  seen  that,  for  given  values  of  ^ ,  the  necessary  conditions 
(2.20a-b)  would  generally  result  in  linear  equations  of  the  form 
N 

D  -  Z  U.DV  +  P  (2.21) 

i-1 

where  U^,  and  P  are  matrices  of  proper  dimensions,  evaluated  in 
terms  of  ;  i,  j*  1,2, 3, 4,  and  N  is  a  nonnegative  integer. 

A  numerical  algorithm  for  solving  equation  (2.21)  will  be  presented 
in  section  2.3.  It  will  also  be  seen  that  in  the  cases  of  the 


'V 
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delay  occurrence  in  the  plant,  equation  (2.21)  will  be  as  simple  as 

D  =  P  (2.22) 

Since  P,  IL  and  contain  K^;  i,  j  =  1,2, 3, 4  which,  in  turn, 
depend  on  D,  we  use  the  following  iterative  algorithm  to  compute  the 
optimal  D  and  K,  in  case  of  using  an  observer: 

1.  Start  with  an  initial  guess  for  D 

2.  Solve  the  Lyapunov-type  equations  to  evaluate  ;  i,j=l,2,3,4. 

3.  Compute  a  new  value  of  D  from  equation  (2.22)  or  by  solving 
equation  (2.21). 

4.  Compare  the  new  value  of  D  with  the  old  one.  If  it  is  close  enough, 
stop.  If  it  is  not  close  enough,  start  a  new  iteration  repeating 
steps  2  and  3  using  the  new  value  of  D. 

2.2.  Stochastic  Systems 

Analogous  to  the  deterministic  systems  considered  in  section  2.1, 
we  will  study  linear  dynamic  systems  with  feedback  controls,  assuming 
disturbance  occurrence  in  both  the  state  equation  and  the  output  equation. 
The  state  equation  in  this  case  is 

x(t)  =  A  x (t )  +  C  u(t)  +  wx(t)  (2.23) 

with  x(0)  =  xq 

where  x(t)  €Rn,  u(t)  €Rm,  w^(t)  gRn  and  A  and  C  are  matrices  of  appropriate 
dimensions.  The  output  equation  is 

y(t)  =  E  x (t )  +  w2(t)  (2.24) 

l  £ 

where  y(t)  €r  ,  w2(t)  €r  and  E  is  a  matrix  of  appropriate  dimensions. 
w^(t)  and  w2(t)  are  uncorrelated  zero  mean  white  noise  processes  with 
spectral  density  matrices  and  I2  respectively.  If  an  observer  is  used, 
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it  is  assumed  Co  have  the  following  dynamic  equation 

z(t)  =  (A  +  B)z(t)+Cu(t)+F(y(t)  -  Ez(t) )  (2.25) 

with 

u(t)  -  Dz(t) 


where  z(t)£Rn  and  F  and  D  are  matrices  of  appropriate  dimensions.  We  may 
use  a  state  feedback  control  law  of  the  form  (2.4),  an  output  feedback 
control  law  of  the  form 


u ( t)  -  Dy(t) 

*  D  E  x(t) 


(2.26) 


Analogous  to  the  study  of  deterministic  systems,  we  will 
consider  the  different  possibilities  of  occurrence  of  a  delay  in  the 
system.  If'a  delay,  u,  is  expected  to  occur  in  the  plant,  the  state 
equation  will  be  of  the  form 


x (t)  *  A  x(t)  +  B  x(t-u)  +  C  u(t)  +w^(t)  (2.27! 
with  x(0)  =  xq 

along  with  the  control  law  (2.4),  (2.25)  or  (2.26).  If  a  delay,  u,  is 
expected  to  occur  in  the  feedback  path,  the  state  equation  (2.23)  will 
remain  unchanged  along  with  one  of  the  following  control  laws: 


u(t)  -Dx(t-H.) 
or 


(2.28! 


u ( t)  -  DE  x(t-H) 


(2.29) 


If  an  observer  is  used,  we  assume 
y(t)  -  e  x(t-^)  +  w2(c) 


(2.30) 


along  with  equation  (2.25).  The  case  of  a  delay  in  the  reconstructed  state 
is  also  considered  for  the  purpose  of  completeness.  But  it  is  not  common 
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as  discussed  in  Section  2.1.  So,  we  will  also  consider  a  control  law  of 
the  form 


u(t)  *  Dz(t-H) 


(2.31) 


associated  with  the  observer  dynamics  given  by  equation  (2.25). 

The  standard  linear  regulator  problem  is  to  minimize  a  quadratic 


performance  index  of  the  form 


J  =  j  lim  ~  E{J  (x'Qx  +  u'Ru)dt} 
2  T— 05  T  o 


(2.32) 


where  e{*}  denotes  the  expected  value  and  Q  and  R  are  matrices  of 
appropriate  dimensions . 

For  our  problem,  low  sensitivity  can  be  achieved  by  incorporating 
the  sensitivity  function  defined  in  equation  (2.13)  in  a  performance  index. 
The  augmented  performance  index  to  be  minimized  is  of  the  form 


J  =  h  lim  ~E{J  (x'Qx+u'Ru  +  a’  So  )dt} 
2  T-*“  T  o  xx 


(2.33) 


where  S  is  a  matrix  of  appropriate  dimensions.  As  discussed  in  the  above 

section,  we  do  not  have  to  introduce  o  (t),  if  an  observer  is  used,  in 

z 

the  performance  index  J. 

Now,  we  present  a  brief  description  of  the  optimization  procedure, 
which  we  will  carry  out  to  derive  the  necessary  conditions  of  the  performance 
index  (2.33)  to  be  minimized. 

1.  Derive  the  dynamic  equation  of  the  closed  loop  sensitivity  functions 

a  (t)  and  u  (t) ,  in  case  of  using  an  observer,  by  calculating  the 
x  z 

first  partial  derivative  of  the  state  equation  (2.23)  or  (2.27)  and 

(2.25),  if  an  observer  is  used,  after  applying  the  proper  control  law. 

Then  substitute  with  the  nomial  value  of  the  delay,  i.e.,zero,  in  all 

3w^(t)  5w^(t) 

of  the  equations.  Note  that  r- -  =  r-  =  0- 
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2.  Form  an  augmented  state  vector 

"x(tf 


x(t) 


a*(t> 


(2.34) 


or,  If  an  observer  is  used, 


x(t) 


x(t) 

z(t) 


ax(t) 


az(t) 


(2.35) 


Hence,  form  A,  Q  and  w(t)  such  that  the  problem  is  reformulated  as 

l  l  X  , _ 

minimize  J  *  ^  lim  “  E £ J  x  Qxdt} 

T-“  o 


with 


x  *  Ax  +  w 


and  define 


(2.36) 


(2.37) 


E  **  Efw  w'  } 


(2.38) 


It  is  shown  [22]  that  equations  (2.36)  and  (2.37)  can  be  expressed 
as  an  equivalent  static  minimization  problem: 


minimize  J  =  j  tr(Q  P] 

such  that  P  is  the  solution  of  the  equation 


(2.39) 


A  P  +  PA'  +  E  =  0  (2.40) 

It  is  also  proved  [22]  that  a  necessary  condition  for  J,  given  by  (2.39)- 
(2.40),  to  be  minimal  is 


0 


3D 


3D 


tr{A  PK  +  j  K  E 


(2.41) 


where 
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A'K  +  KA  +  Q  -  0  (2.42) 

AP  +  PA’  +  S  =  0  .  (2.43) 

If  an  observer  is  used,  one  more  equation  of  the  form  (2.41)  will  be 
used  to  get  the  optimal  value  of  F.  Similar  to  what  we  got  in 

the  deterministic  case,  we  have  to  use  an  iterative  algorithm  to  compute 

\ 

the  optimal  feedback  gains.  That  is  because  P  and  K,  obtained  by 
solving  (2.42)  and  (2.43),  depend  on  D.  Then  they  are  used  in  (2.41) 
to  get  D.  The  following  algorithm  will  be  used 

1.  Start  with  an  initial  guess  for  D. 

2.  Form  A,  Q  and  Z  and  hence  solve  equations  (2 .42) - (2 .43)  to  get  P  and  K. 

3.  Solve  equation  (2.41)  to  obtain  a  new  value  of  D- 

4.  Compare  the  new  D  with  the  old  one.  If  it  is  close  enough,  stop. 

If  it  is  not  close  enough,  start  a  new  iteration  repeating  steps 
2  and  3  using  the  new  value  of  D. 

2.3.  Existence  of  a  Solution 

Let  the  necessary  conditions  be  generally  given  by 

f(D»S)  -  0  (2.44) 

It  is  known  [2]  that  for  S  =  0,  there  exists  D°  such  that  f(D°,0)  =  0. 

So,  by  the  implicit  function  theorem,  there  exist  open  sets  UCr1™1411*11 
and  WCR™  with  (D°,0)  €U  and  0  €w  such  that  to  every  S  €w  corresponds  a 
unique  D*  such  that  (D*,S)  €U  and  f(D*,S)  =0.  In  other  words  there 
exists  D*  which  satisfies  (2.44)  for  any  S  in  the  neighborhood  of  0. 

The  algorithms  presented  in  Sections  2.1  and' 2.2  are  similar  to 
the  gain  approximation  algorithm  which  corresponds  to  the  successive  over 
relaxation  (SOR)  algorithm  for  the  Gauss-Seidel  iteration.  It  is  proved  [22] 
that  the  direction  determined  by  that  algorithm  at  the  kth  iteration  is  a 
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downhill  direction.  Thus  this  algorithm  is  in  fact  a  descent  method.  The 
proofs  for  the  cases  considered  in  this  thesis  are  similar  to  the  proof 


presented  in  [22],  Step  number  2  of  both  algorithms  is  to  solve 

Lyapunov-type  equations  which  can  be  done  using  the  Riccatti  package  of 
Linsys  prepared  by  Bingulac  [23].  Step  number  3  of  both  algorithms  is 
to  solve  an  equation  of  the  form  (2.21).  Here  we  propose  an  algorithm  to 
solve  that  equation. 

Consider  the  following  iterative  algorithm 


D.  -  £  U.D.V.  +  P 

i+1  j-i  J  1  J 


(2.45) 


with  D  *  P 
o 


To  prove  convergence  of  that  algorithm  we  let  p  -  sup{p(U.),  p(V.)}; 

j  J  J 

j  *  1,...,  N  where  p(Uj)  and  p(V^)  are  the  spectral  radii  of  and  V^, 

til 

respectively.  The  error  in  the  i  iteration  is  defined  as  e^  =  -  Di+1> 

and  its  norm  is  found  [7]  to  satisfy  the  following  inequality 


9  A 

llejl  *  (i+i)Y  •  (.m  )  •  r 


(2.46) 


where  V  and  T  are  positive  constants.  If  we  assume  that  Np  <  1,  the  right 
hand  side  will  go  to  zero  as  i  -  So,  the  algorithm  (2.45)  converges 
under  the  sufficient  condition 


P  <vi 


(2.47] 


2 .4.  Advantages  of  this  Design  Scheme 

The  problem  considered  in  this  thesis  is  an  extension  of  the 
standard  Linear -Quadratic  problem  as  described  in  sections  2.1  and  2.2. 

Q,  R  and  S,  defined  in  equation  (2.14),  are  design  parameters  to  be  adjusted 
in  order  to  get  a  desirable  behavior.  The  matrix  Q  is  responsible  for  the 
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regulation  of  the  states  according  to  a  desired  weighting.  The  matrix  R 

is  responsible  for  minimizing  the  control  effort.  The  matrix  S  is 

responsible  for  reducing  trajectory  sensitivity  to  a  small  time  delay  of 

the  system  states  according  to  a  desired  weighting.  This  design  scheme  is 
reliable  since  it  provides  a  guaranteed  approach  to  reduce  sensitivity 

in  general.  The  choice  of  S  with  a  specific  weighting  is  reflected 

directly  on  the  sensitivity  of  the  different  state  trajectories.  This 

direct  handle  on  sensitivity  is  the  main  advantage  of  this  proposed  design 


scheme. 
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CHAPTER  3 

DETERMINISTIC  SYSTEMS  WITH  A  TIME  DELAY  IN  THE  PLANT 

3.1.  State  Feedback  Control 

Referring  to  the  general  problem  formulation  stated  in  Section 

2.1,  we  have,  in  this  case,  a  state  equation  (2.7)  along  with  a  state 
feedback  control  law  (2.4)  and  a  performance  index  (2.14). 

The  equations  to  be  solved  are  summarized  as  follows: 


KUA+A 

'KU 

=  -Q  +  K12BA+A’B'K21 

(3.1) 

k12a+a 

'K12 

“A'B'K22 

(3.2) 

A 

■k2i 

-k22ba 

(3.3) 

k22a+a 

'k22 

*  -s 

(3.4) 

AM  +  MA' 

s  -2 

(3.5) 

AGl  +GjA'  =  BAM 
AG2+G2A'  “Gj^A'B'  +  bag[ 

r 

D-R_1C'  {  (B'Kjj  -KU)M+  (B'K22  - 

i  1 

"  “  K22G2  )  M 

J 

where 


(3.6) 

(3.7) 

(3.8) 


A  *  A  +  B  +  CD 


(3.9) 


Q  -Q  +D'RD 


(3.10) 
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f 

* 


and 


£  =  Elx  x’} 

o  o 


(3.11) 


The  above  equations  are  obtained  directly  by  applying  the  optimiza¬ 
tion  procedure  described  in  Section  2.1.  Here  we  present  the  main  steps  of 
the  derivation.  For  |x  =  0,  we  have  [1} 


x  =  A  X 

*  =*  A  a  -  BAX 


(3.12) 

(3.13) 


and 


J  -  |  T^x'Qx  +  o' S  o)  dt 


where  A  and  Q  are  defined  above.  The  Hamiltonian  is  given  by 

H  =  w  X  '  Qx  +  —  a'Sc  +  X'Ax  +  \'  A  a  -  \'BAX 
2  2  x  a  o 

\  --f  -  -«x  +  A'Xx-A'BV 


Xcr  *  '  d5  =  "<SCT  +  A'V 


(3.14) 


(3.15) 

(3.16) 

'  (3.17) 


\  and  \  are  related  to  X  and  o  by  the  equations  (2.17a-b).  Hence  we 

A  O 

obtain  the  equations  for  K^,  K^,  and  stated  above.  To  apply  the 
necessary  condition  (2.20a)  we  evaluate  the  partial  derivative  of  H  with 


jJ 


respect  to  D. 


H  »  RDXX'  +C'K1LXX'  +c'k12ctx'  -  c'b'k^xx* 


ft-  JS^20  A  -U  O  ^21 

x »  +  c'K..x  a1  +  C’K _ ao' 


-  C'B'K 22ax'  +  c <K2lx  a'  +  C,K22  (3.18) 

Hence  we  obtain  the  above  equation  for  D  along  with  the  equations  of  M, 


G^  and  G2. 


3.2.  Output  Feedback  Control 

'Referring  to  the  general  problem  formulation  stated  in  Section 
2.1,  we  have,  in  this  case,  a  state  equation  (2.7)  along  with  a  control 
law  (2.5)  and  a  performance  index  (2.14). 

The  equations  to  be  solved  are  summarized  as  follows: 


KUA  +  A'KU  «  -Q  +  K12BA  +  A'B'K21 


k12a  +  a'k12  =  a,b'k22 


K2iA  +  A’X^  =  X22BA 


K22A  +  a'k22  *  -s 


AM  +  MA'  =  -E 


+  GjA 1 

=■  BAM 

+  g2a' 

«  gla 

c 

■  R^C' 

\  (B'K. 

K21Gi  - 

K22G2 

(3.19) 

(3.20) 

(3.21) 

(3.22) 

(3.23) 

(3.24) 

(3.25) 


(3.26) 


where 


A  -  A  +  B  +  CDE  (3.27) 

Q  =  Q  +  E'D'KDE  (3.28) 


and 


2  *  E^0  Xo^  ( 3.29 ) 

The  above  equations  are  obtained  directly  by  applying  the  optimi¬ 
zation  procedure  described  in  Section  2.1.  Here  we  present  the  main  steps 
of  the  derivation.  For  p.  * 0 ,  we  have 


x  -  AX  (3.30) 

i  *  A  ct  -  BAX  (3.31) 


and 


1  00 

J  =  -r  p  (x’Qx  +  o'S  o)dt 
1  <r 

where  A  and  Q  are  defined  above.  The  Hamiltonian  is  given  by 


(3.32) 


H-jX'QX+jO'So+X^AX+X^Aa-^BAX  (3.33) 

We  notice  that  H,  as  a  function  of  A  and  Q,  has  the  same  form  as  that  at 
Section  3.1.  Hence  the  equations  for  K^»  K^>  K21  an<^  K27  are  C*ie 
same  form  as  those  of  Section  3.1.  The  partial  derivative  of  H  with 
respect  to  D  is  then  evaluated  and  the  necessary  condition  (2.20a)  gives 
the  above  equation  along  with  the  definitions  of  M,  and  G2 • 


lA 
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3.3.  Use  of  Observers 

Referring  to  the  general  problem  formulation  stated  in  Section 
2.i,  we  have,  in  this  case,  a  state  equation  (2.7),  an  output  equation 
(2.2)  and  an  observer  (2.3)  along  with  a  control  law  (2.6)  and  a  perfor¬ 
mance  index  (2.14). 

The  equations  to  be  solved  are  summarized  as  follows: 


Kj^A+A'Kj^  -  -Q  -E'K'RKE  -  E'G'K^  +  A'B'K^  +  K13BA  -  K^GE  (3.34) 

K12F+A'K12  --E'K'RD  -E'G'K22+A'B,K32 +K13BCD  -KuCD  (3.35) 

K^  +  A'K^  *  -E'G'K23+A,B,K33  -K14GE  (3.36) 

K14F+A'K14=*-E'G'K24  +  A,B'K34-K13CD  (3.37) 

K21A  +  F'K2l  «*-D'RKE  -D'C'K11  +  D'C'B’K3l+K23BA  -K^GE  (3.38) 

K22F  +  F'K22  *-D'RD  -D'C'K12+D,C'B'K32 +K23BCD  -K2lCD  (3.39) 

K23A  +  F'K23  -  -D'C'K13  +  D,C'B,K33  -  K^GE  (3.40) 

K24f+f,K24--D'c,Ki4  +  d,c'b,K34  -K23CT  (3.41) 

K3]A+A'K31  -  -E'G’K41  +K33BA  -  K32GE  (3.42) 

K32F+A'K32  -  -E'G'K42+K33BCD  -K31CD  (3.43) 

K33A+A’K33  - -S  -E'G'K43  -K34GE  (3.44) 

K34F+A'K34--E'G'K44-K33CD  (3.45) 

K4iA  +  F ' K41  -  -D ' C 1 K31  +  K43BA  -  K^GE  (3.46) 
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K42F  +  F ' K42  ’  _D ' C 'K32  +  K43BCD  ‘  ^l00 


K43A  +  F'K43--D'C,K33-K44GE 


K44F  +  F’K44“_D'C,K34_K43CD 


D*r'1IC'[B'P2  -P1-P3]  -RKEM^jMjJ 
K  =  R“1{c'[B'P5  -  P  -  P4J  -  RDM213e'  (EM^E')-1 
where 
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A  -  A  +  B  +  CKE 


+  K12M22 

+  K13M32 

+  K14M42 

+  K32M22 

+  k33m32 

+  K34M42 

+  k32M24 

+  K33M34 

+  K34M44 

+  K12M21 

+  K13M31 

+  K14M41 

+  k32m21 

+  K33M31 

+  K34M41 

+  K32M23 

+  k33m33 

+  K34M43 

MU 

M12 

M13 

M14 

M21 

^22 

M23 

M24 

M  ■ 

M31 

M32 

M33 

M34 

M41 

M42 

M43 

M*4 

AM  +  MA'  +4  =  0 


(3.47) 

(3.48) 

(3.49) 

(3.50) 

(3.51) 

(3.52) 

(3.53) 

(3.54) 

(3.55) 

(3.56) 

(3.57) 

(3.58) 


(3.59) 


(3.60) 
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v 


i 


f 

i 


9f 

i 


GE 


-BA 


CD 


-BCD 


CD 


GE 


^  ■  E[xo  x;J 


£  m  Elz  z'} 
z  o  o 


(3.61) 


(3.62) 


(3.63) 

(3.64) 


Here  we  present  the  main  steps  of  the  derivation  of  the  above 
equations.  For  n  *  0,  we  ha ^e 


*  »  AX  +  CDz 

z  -  GEX  +  Fz 

4  -  -BAX  -  BCDz  +  A  a  +  CD  c 

X  X  2 

a  -  GE  a  +  F  a 
z  X  z 

The  Hamiltonian  is  given  by 


(3.65) 

(3.66) 

(3.67) 

(3.68) 
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H  *  ^x'Qx  +  |z'D'RE>z  +  j  X  'E  'K'RKE  X  +j  X  'E  'K'  RDz  +  j  z'D'RKEX 
+  ja^  S  a^+  X^AX  +  X^  CDz  +  X^GEx+  X2'Fz  +  X^  [-BAX  -  BCDz  +  A  +  CD 

+  X'[GEcr+F  a]  (3.69) 

^  _  X  z 

z 

Then,  the  equations  summarized  above  follow  from  the  optimization  procedure 
described  in  Section  2.1  along  the  proper  definitions  of  A,  A  and  L  . 
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CHAPTER  4 

DETERMINISTIC  SYSTEMS  WIIH  A  TIME  DELAY  IN  THE  FEEDBACK  PATH 

4.1,  State  Feedback  Control 

In  this  case,  we  have  a  state  equation  (2.1)  along  with  a  control 
law  (2.8)  and  a  performance  index  (2.14). 

The  equations  to  be  solved  are  summarized  as  follows*. 


KUA+A'KU--Q  +  K12CDA+A'D'C'K21  (4.1) 

K12A+A'K12 -A'D'C,K22  (4.2) 

K^A  +  A'K^-K^CDA  (4.3) 

K22A+A'K22--S  (4.4) 

AM  +  MA'--2  (4.5) 

AG i  -♦*  G iA *  »  CDAM  (4.6) 

AG2+G2A'  -GjA'D'C'  +CDAG[  (4.7) 

D  -R_1C'1(D'C,K21  -  KU)M+  (D'C'K22  -  KJ2)G1 
+  (K2lM  +  K22G1)D'C*  "K21G{  -K^G^m"1  (4.8) 

where 

A-A  +  CD  (4.9) 

Q  "Q  +  D'RD  (4.10) 


and 
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2  =  e£xo  }  (4.11) 

The  above  equations  are  obtained  directly  by  applying  the 
optimization  procedure  described  in  Section  2.1.  Here  we  present  the  main 
steps  of  the  derivation.  For  we  have 

x*AX  (4.12) 

d-Aa-CDAX  (4.13) 

and 

J-|  /"  (x'Qx  +  o'  Scr)dt  (4.14) 

o 

where  A  and  Q  are  defined  above.  The  Hamiltonian  is  given  by 

H«|x’  Qx  +  |ct'  Sa  +  \^  AX  +  r  Aj-X^CDAx  (4.15) 

Then,  the  equations  summarized  above  follow  from  the  optimization  procedure 
described  in  Section  2.1  along  with  the  proper  definitions  of  M,  and  G2 . 


4.2.  Output  Feedback  Control 

Referring  to  Section  2.1,  we  have,  in  this  case,  a  state  equation 
(2.1)  along  with  a  control  law  (2.9)  and  a  performance  index  (2.14). 

The  equations  to  be  solved  are  summarized  as  follows: 


K11A+A’K11  *  -Q  +  K12CDEA+A'E,D'C'K21 


(4.16) 
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where 


and 


K12A  +  I'K12  -A'E'D’C'K22 


K21A+A'K2l  -K22CDEA 


k22I+a'k22  *  -s 

AM+MA'  -  -Z 

AG:  +  GjA '  ■  CDEAM 

AG2+G2A'  -GjA'E'D'C'  +  CDEAG^ 


r 

D-R'1C  \  tt'D'C'Kji 
+  (K^M  +  K^G^E'D'C' 


K1L)M+  (E‘D' 

*2lCi**22C2 


C’K22‘K12>G1 
|  E '  (EME 1 )  ~ 1 


A  ■  A  +  CDE 

Q  =  Q  +  E  'D 'RUE 


E-Elx  x'} 
o  o 


(4.17) 

(4.18) 

(4.19) 

(4.20) 

(4.21) 

(4.22) 

(4.23) 

(4.24) 

(4.25) 

(4.26) 


The  above  equations  are  obtained  directly  by  applying  the  optimi¬ 
zation  procedure  described  in  Section  2.1.  Here  we  present  the  main  steps 
of  the  derivation.  For  H*0,  we  have 


x  -  AX  (4.27) 

d  »  Ac  -  CDEAX  (4.28) 


and 
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J  -  \  f  <x'Qx  +  a'sa)dt  (4.29) 

o 

where  A  and  Q  are  defined  above.  The  Hamiltonian  is  given  by 

H  =  |x'Qx  +  jCT'Sff+  XVAx  +  XjAff  -  X^CDEAx  (4.30) 

Then,  the  equations  summarized  above  follow  from  the  optimization  procedure 
described  in  Section  2.1  along  with  the  proper  definitions  of  M,  and  G2* 


4.3,_Use  of  Observers  with  the  Delay  in  the  Reconstructed  State 

Referring  to  Section  2.1,  we  have,  in  this  case,  a  state  equation 
(2.1),  an  output  equation  (2.2)  and  an  observer  (2.3)  along  with  a  control 
law  (2.10)  and  a  performance  index  (2.14). 

The  equations  to  be  solved  are  summarized  as  follows: 


KUA+A'KU  -  -Q  -E'K'RKE  -  E  'G'K^  +E,G'D'C'K31  +K1;jCDGE  -  K^GE  (4.31) 
K12F+A'K12  --E'K'RD  -E'G,K22+E'G'D'C'K32+K13CDF  -KuCD  (4.32) 

K13A  +  A'K13  -  -E'G,K23  +  E'G'D'C'K33  -  K14GE  (4.33) 

K14F+A'K14«-E,G'K24  +  E,G,D,C,K34  -K13CD  (4.34) 

K2lA  +  F’K2l  -  -D'RKE  -D'C'Kj^j^  +  F'D'C’K^  +K23CDGE  -  K22GE  (4.35) 

K22F  +  F'K22  --D'RD  -D'C'K12+F'D,C'K32+K23CDF-K21CD  (4.36) 

K23A  +  F'K23--D'C,K13  +  F'D'C,K33  -K24GE  (4.37) 

K24F  +  F,K24"'D'C'K14  +  F'D,C'K34‘K23CD  (4.38) 

K31A  +  A'K31  - -E'G'K41  -  K32GE  +  K33CDGE  (4.39) 
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K32F  +  A ' K32  » -E ' G ' K42  +  K33CDF  -  K31CD 

k33a+a'k33  -  -s  -e'g'k43  -k34ge 
k34f+a'k34--e'g'k44-k33cd 

K41A  +  F'K4l  -  -D'C'K3l  +K43CDGE  -  K42GE 

K42F  +  F ' K42  * 'U ' C ' K32  +  K43CDF  “  K4l CD 
'<43S  +  E"K43--D'C'K33-K44OT 
k44F  +  F'K44--0'C'K34-  K43CD 

D^-r'1  +P3P’  "P1  “V  “RKEM12|  “2 2 

K-R'1  |-[RDM21  +  C,(P5  +  P6)]E’j  (EM11E1)'1 

where 
A  -A  +  CKE 

Pl * K11M12  +  K12M22  +  K13M32  +  K14M42 
p2  -k31mu  +  k32m21  +k33m31  +  k34m41 

P3  “  ^1^2  +  K32**22  +  K33M32  +  K34M42 

P4  *  K31M14  +  K32M24  +  K33M34  +  K34M44 

P5-KUM11  +  K12M21  +  K13M31  +  K14M41 

P6  “  K31M13  +  K32M23  +  K33M33  +  K34M43 
AM+MA'  +  I  «  0 


(4.40) 

(4.41) 

(4.42) 

(4.43) 

(4.44) 

(4.45) 

(4.46) 

(4.47) 

(4.48) 

(4.49) 

(4.50) 

(4.51) 

(4.52) 

(4.53) 

(4.54) 

(4.55) 

(4.56) 


I 
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A  - 


GE  F  0 

CDGE  -CDF  A 


0 

CD 


0 


0  GE  F 


(4.57) 


,i, j*l,2,3,4  are  the  partitions  of  the  matrix  M  as  in  equation 
(3.59)  and  Z  is  defined  by  equations  (3. 62) - (3. 64) . 

Here  we  present  the  main  steps  of  the  derivation  of  the  above 
equations.  For  jJi-O,  we  have 


x  *  Ax  +  CDz 

(4.58) 

z  =*  GEx  +  Fz 

(4.59) 

*  -  -CDGEx  -  CDFz  +Aff  +  CDff 

X  X  z 

(4.60) 

<Jr  -  GEa  +  Fa 

(4.61) 

Z  X  z 

The  Hamiltonian  is  given  by 

H  --£x'  Qx+-r  z'D’RDz+  ^x,E'K'RKEx  +  x'E'K'RDz-hr  z'D'RKEx-Hr  cr'  Sa 
2  2  2  2  2  2  x  x 

+  X*  (Ax+CDz)  +  \!  (GEx  +  Fz)  +  X*  (-CDGEx  -  CDFz  +  Aa  +  CDa  )+X'  (GEa  +  F a  ) 

X  Z  CT  X  Z  X  Z 

X  z 

(5.80) 

Then,  the  equations  summarized  above  follow  from  the  optimization  procedure 
described  in  Section  2.1  along  with  the  proper  definitions  of  A,  A  and  Z  . 
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*-6.  Use  of  Observers  with  the  Delay  in  the  System  Output 

Referring  to  Section  2.1,  we  have,  in  this  case,  a  state  equation 
(2.1),  an  output  equation  (2.2)  and  an  observer  (2.3)  along  with  a  control 
law  (2.11)  and  a  performance  index  (2.14). 

The  equations  to  be  solved  are  summarized  as  follows: 

kua+a’ku--q  -e'k’rke  -e,g'k21-)-a’e'k'c,K31+a,e'g,k41+k14gea 


+  K13CKEA  (4.62) 

K12F+A’K12  «  -E’K’RD  -E'G’K22  +  AiE'K'C'K32  +  A'E'G'K42  +KuGECD 

+  K^CKECD  -  Kl1CD  (4.  63) 

K13A+A'K13  -  -E,G,K23+A,E'K'C'K33+A,E'G,K43  -K14GE  (4.64) 

K14F+A'K14--E,G,K24  +  A'E,K'C,K34+A’E,G'K44  -K13CD  (4.65) 

k21a  +  f’k21  --D'RKE  -D’C'K^D'C'E'K'C'K^+D’C’E’G'K^+K^GEA 

+  K^CKEA  -  K22GE  (4.66) 


K22F+F'K22  -  -D'RD  -  D'C'K^+D'C'E'K'C'K^+D'C'E’G'K^+K^GECD 


+  K^CKECD  -KjjCD  (4.67) 

K23A  +  F'K23  --D'C'K13+D'C,E'K'C'K33+D'C'E,G,K43  -K24GE  (4.68) 

K24F  +  F'K24--D'C'K14  +  D,C'E,K'C,K34+D,C,E'G'K44-K23CD  (4.69) 

k31a+a'k31  --e'g'k41+k43gea  +  k33ckea  -k32ge  (4.70) 

k32f+a'k32  --e'g'k42  +  k34gecd  +  k33ckecd  -k31cd  (4.71) 
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K33A+A'K33  --S  -E'G'K43  -K34GE  (4.72) 

K^F+A'K^-'E'G'K^-K^CD  (4.73) 

K41A+F'K41  »  -D'C'K3l+K44GEA  +  K43CKEA  -K42GE  (4.74) 

K42F  +  F'K42  --D'C’K^+K^GECD  +  K^CKECD  -K41CD  (4.75) 

K43A  +  F,K43--D'C'K33  -K^GE  (4.76) 

K44F  +  F'K44”'D,C'K34‘K43CD  <4‘77> 

D-R"1  |c,[E,K,C’P2+E,G,P4-P1-P3]-RKEH12|  M^2  (4.78) 

f  > 

K  -R'1  C1  [PgE'K'C1  +E'K,C'P6  +  P2D,C'  +E*G’P8  -  P5  -  PyJ-RDM^y 

E'(EMuE')"L  (4.79) 

where 

A  -  A  +  CRE  (4.80) 

P1  •KUM12+K12M22  +K13M32  +C14M42  (4'81) 

P2  *  K3|M^2  +  ^23^22  4  ^34^42  (4.82) 

P3  *  K31M14  +  K32M24  +  K33M34  +  K34M44  <4 • 83> 

P4  “  K41M12  +  K42M22  +  K43M32  +  M44M42  (4.84) 

P5  "KUM11  +  K12M21  +  K13M31+K14M41  (4*85) 

Pg  "  ^31^11  ^32^21  ^33^31  ^34^41  (4. 88^ 


P7  “  K31M13  +  ^32^23  +  K33M33  +  K34M43 


(4.87) 
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P8  "  K41M11  +  K42M21  +  K43M31  +  K44M41 
A  M  +  MA'  +  Z  »  0 


~  1 

CD  1 

| 

0 

1 

0 

GE 

F  I 

0 

1 

1 

0 

-CKEA 

-CKECD 

A 

1 

1 

CD 

_ 

-GEA 

-GECD  i 

GE 

1 

I 

F 

(4.88) 

(4.89) 


(4.90) 


Mij’  are  Parti-ci-ons  of  M  as  in  equation  (3.59)  and 

L  is  defined  by  (3.62)  -  (3.64). 

Here  we  present  the  main  steps  of  the  derivation  of  the  above 
equations .  For  p  =  0,  we  have 

x  ■  Ax  +  CDz 

z  ■  GEx  +  Fz 

a  ■  -CKEAx  -  CKECDz  +  Ac  +  CDC 
X  X  z 

d  •  -GEAx  -  GECDz  +  GEC  +  Fo 
z  x  z 

The  Hamiltonian  is  given  by 

H  — |x'  Qx+-i  z,D'RDz+  -7  x'E'K'RKEx+  ^  x'E'K'RDz  +  ~  z'D'RKEx  +  •~CT*  So 
2  2  2  2  2  2xx 

+  (Ax  +  CDz) +\^(GEx  +  Fz) (-CKEAx  -  CKECDz +Aax  +  CDcz) 

X 

+  (-GEAx  -  GECDz +  GEax  +  Faz)  (4.95) 

z 

Then,  the  equations  summarized  above  follow  from  the  optimization  procedure 
described  in  Section  2.1  along  with  the  proper  definitions  of  A,  A  and  2  . 


(4.91) 

(4.92) 

(4.93) 

(4.94) 
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CHAPTER  5 

STOCHASTIC  SYSTEMS  WITH  A  TIME  DELAY  IN  THE  PLANT 


5.1.  State  Feedback  Control 

Referring  to  section  2.2,  we  have,  in  this  case,  a  state  equation 
(2.27)  along  with  a  control  law  (2.4)  and  a  performance  index  (2.33). 

The  equations  to  be  solved  are  summarized  as  follows: 


A'K  +  KA  +  Q  =  0 
A  P  +  PA'  +  £  =  0 


(5.1) 

(5.2) 


KP  = 


(KP) 

(KP) 


11 

<kp>i2 

21 

CM 

CM 

PM 

P11 

P12 

K11 

K12  1 

P  = 

, 

_P2 1. 

1 

CM 

Pm 

,  (5.3) 

K  = 

j 

l 

"1 

CM 

I 

_ 

(5.4) 


(5.5) 


D  =  r'1[C[B'(KP)21  -  (KP)n  -  (KP)22]}  .  P"J 


(5.6) 


where 


A  =  A  +  B  +  CD 


(5.7) 

(5.8) 


Q  =  Q  +  D'RD 

E  =  E{w^  w|] 


(5.9) 


The  abc’'e  equations  are  obtained  directly  by  applying  the 
optimization  procedure  described  in  section  2.2.  Here  we  present  the  main 


steps  of  the  derivation.  For  ^  =  0,  we  have 
x  =  Ax  +  w^ 
cr  =  Act  -  BAx  -  Bw^ 

Define 


(5.13) 

(5.14) 


"x“ 

W1 

X  ■ 

(5.15)  , 

w  = 

1 

-Bw^ 

(5.16) 


Hence,  we  have  an  equivalent  static  minimization  problem  described  by 
equations  (2 .39) -(2 .40)  with  A,  Q  and  I!  as  defined  above.  The  necessary 
conditions  follow  directly  from  equations  (2 .41) - (2 .43)  making  use  of 
the  fact  that  a  trace  of  a  block  matrix  is  equal  to  the  sum  of  traces 
of  the  diagonal  blocks. 


5.2.  Output  Feedback  Control 

Referring  to  section  2.2,  we  have,  in  this  case,  a  state 
equation  (2.27)  and  an  output  equation  (2.24)  along  with  a  control  law 
(2.26)  and  a  performance  index  (2.33). 

The  equations  to  be  solved  are  summarized  as  follows; 

A'K  +  KA  +  Q  =  0  (5.17) 

AP  +  PA'  +  i  =  0  (5.18) 


D  =  R*1  £4  ~|  (EPUE')'1 

4  =  c'Cb'(kp)21  -  (kp)u  -  (kp)22}e' 

where 

A  =*  A  +  B  +  CDE 
Q  =  Q  +  E'D'RDE 

E1  =  E^wlwi^ 


(5.19) 

(5.20) 


(5.21) 

(5.22) 

(5.23) 


A  ” 


0 

Q  0 

,  (5.24)  Q  « 

A 

0  S_ 

y, 


-v 


B4B’ 


(5.25) 


(5.26) 


Pij ’  Ki’  3nd  =  are  partitions  of  P,  K  and  (KP)  as  in 

equation  (5.3)  -  (5,5). 

The  above  equations  are  obtained  directly  by  applying  the 


optimization  procedure  described  in  section  2.2.  Here  we  present  the 
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main  steps  of  the  derivation.  For  u.  *  0,  we  have 

x  “  Ax  +  w,  (5.27) 

a  m  TZa  -  BSx  -  B  w^  (5.28) 


Define 


(5.29) 


(5.30) 


Hence,  we  have  an  equivalent  static  minimization  problem  described  by 
equations  (2 .39)-(2 .40)  with  A,  Q  and  £  as  defined  above.  The  necessary 
conditions  follow  directly  from  equations  (2 .41)- (2 .43) . 


5.3.  Use  of  Observers 

Referring  to  section  2.2,  we  have,  in  this  case,  a  state 
equation  (2.27),  an  output  equation  (2.24)  and  an  observer  (2.25)  along 
with  a  performance  index  (2.33). 

The  equations  to  be  solved  are  summarized  as  follows 


A'K  +  KA  +  Q  »  0 


(5.31) 


AP  +  PA'  +  £  -  0 


(5.32) 


11 

P12 

P13 

P14 

21 

P22 

P23 

P24 

> 

p 

P 

p„. 

31 

32 

33 

34 

> 

41 

P42 

P43 

P44 

(5.33) 
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The  above  equations  are  obtained  directly  by  applying  the 
optimization  procedure  described  in  section  2.2.  Here  we  present  the  main 
steps  of  the  derivation.  For  a  *  0,  we  have 


i  - 

(A+B)x  +  CDz  + 

(5.44) 

• 

z  = 

FE2T  +  Az  +  Fw2 

(5.45) 

a 

X 

“  -  B(A+B)x  -  BCDz  +  (A+B}c  +  CDc  -  Bw. 

X  Z  1 

(5.46) 

C 

Z 

*  FEc  +  Ac 

X  z 

(5.47) 

Define 
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w 


(5.49) 


Hence  we  have  an  equivalent  static  minimization  problem  described  by 
equations  (2 .39) - (2 .40)  with  A,  Q  and  E  as  defined  above.  The  necessary 
conditions  follow  directly  from  equations  (2 .41) - (2 .43)  with  one  more 
equation,  similar  to  equation  (2.41),  for  optimization  of  F. 
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CHAPTER  6 

STOCHASTIC  SYSTEMS  WITH  A  TIME  DELAY  IN  THE  FEEDBACK  PATH 

6.1.  State  Feedback  Control 

Referring  to  section  2.2,  we  have,  in  this  case,  a  state 
equation  (2.23)  along  with  a  control  law  (2.28)  and  a  performance 
index  (2.33). 

The  equations  to  be  solved  are  summarized  as  follows: 


A'K  +  KA  +  Q  =  0  (6.1) 

AP  +  PA'  +  S  =  0  (6.2) 

D  =  R_1(L1 +L2)P^J  (6.3) 

Lj  *  C'[(KP)21A'  +  K21E1-  (KP)n-  (KP)22J  (6.4) 

L2  -  C'[(KP)21D,C'  +  D'C'(KP)22  -K22CDS1]  (6.5) 

where 

A  =  A  +  CD  (6.6) 

Q  =  Q  +  D’RD  (6.7) 

S1  -  E{w1w1'}  (6.8) 


A  = 


A 

-CDA 


A 


(6.9) 


Q  = 


0 

S 


(6.10) 


4' 


S  = 


-ED '  C ' 
CDEjD'C' 


(6.11) 


P.  . ,  K. .  and  (KP) . . ; 
ij  iJ  iJ 

equations  (5. 3) -(5. 5) 


i,j=l,2  are  partitions  of  P,  K  and  (KP)  as  in 


The  above  equations  are  obtained  directly  by  applying  the 
optimization  procedure  described  in  section  2.2.  Here  we  present  the 
main  steps  of  the  derivation.  For  Ui  =  0,  we  have 


x  =  Ax  +  (6.12) 

a  =  Aa  -  CDAx  -  CDw1  (6.13) 


Define 


x 

a 


w 


-CDw1 


(6.14) 


(6.15) 


Hence,  we  have  an  equivalent  static  minimization  problem  described  by 
equations  (2 .39) - (2 .40)  with  A,  Q  and  S  as  defined  above.  The  necessary 
conditions  follow  directly  from  equations  (2  .41)- (2 .43) . 
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V 


6.2.  Output  Feedback  Control 

Referring  to  section  2.2,  we  have,  in  this  case,  a  state  equation 
(2.23)  and  an  output  equation  (2.24)  along  with  a  control  law  (2.29)  and  a 
performance  index  (2.33). 

The  equations  to  be  solved  are  summarized  as  follows: 


where 


A’K  +  KA  +  Q  -  0 


AP  +  PA’  +  E  -  0 


D  -  r'1(L1+L2)(EPuE')‘1 


Lx  -  C'[(KP)21A'  +  -  (KP)n  -  (KP)22]E' 

^2  *  C,Ct(KP)21E'D'C'  +E’D'C*(KP)21-K22CDES1 


A  ■  A  +  CDE 
Q  ■  Q  +  E'D'RDE 
Zl  -  EfwjW^} 


A  - 


Q  - 


-CDEA 

Q 

0 


(6.16) 

(6.17) 

(6.18) 

(6.19) 

(6.20) 

(6.21) 

(6.22) 

(6.23) 

(6.24) 


(6.25) 
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-E^E ' D ' C ' 


(6.26) 


-CDE^ 


CDEEjE ' D ' c ' 


Pi  j »  and  ijj581)2  are  partitions  of  P,  K  and  (KP)  as  in 

equations  (5. 3) -(5. 5). 

The  above  equations  are  obtained  directly  by  applying  the 

optimization  procedure  described  in  section  2.2.  Here  we  present  the  main 
steps  of  the  derivation.  For  p,  ■  0,  we  have 

x  *  Ax  +  w^  (6.27) 

a  -  Sa  -  CDEAx  -  CDEw1  (6.28) 


Define 


x  ■ 


(6.29) 


w 


(6.30) 


Hence,  we  have  an  equivalent  static  minimization  problem  described  by 
equations  (2  .39) - (2 .40)  with  A,  Q  and  E  as  defined  above.  The  necessary 
conditions  follow  directly  from  equations  (2 .41) - (2 .43) . 


i 
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6.3.  Use  of  an  Observer  with  a  Delay  in  the  Reconstructed  State 

Referring  to  section  2.2,  we  have,  here,  a  state  equation  (2.23), 
an  output  equation  (2.24)  and  an  observer  (2 .25)along  with  a  control  law 
(2.31)  and  a  performance  index  (2.33). 

The  equations  to  be  solved  are  sutnnarized  as  follows: 

♦V 

A'K  +  KA  +  Q  =  0  (6.31) 

AP  +  PA'  +  S  =  0  (6.32) 

D  * "R_1C' [L^  +  L21 P^2  (6.33) 

F--1^J[L3  +  L4]l51  (6.34) 

L1  *  (KP)12  +  (KP)22  +  (KP)34+  (KP)44  “  £<KP)32  +  (KP)42Ja' 

“(  (KP)  31  -  (KP)32+  (KP)41  -  (KP)42}E'F'  -{K^+K^F^F'  (6.35) 

L2-[-(KP)32  -  (KP)42}d’C'  -D*c'[(KP)32  + (KP)42} 

+  {k33  +  K34  +  K43  +  K44}CDFS2F'  (6.36) 

L3  -  f  <KP)21  -  (KP)22  +  (KP)43  -  (KP)44 

+  D'C'i-(KP)31+  (KP)32  -  (KP)41+  (KP)42}]E'  (6.37) 

L4  -  [  -  £  K2  3  +  K24}  CD  -  D '  C '  (  {  K42  +  K32 } 

■^33  +  K43  +  K34  +  K44^CD)]FZ2  (6*38) 

U 


where 


The  above  equations  are  obtained  directly  by  applying  the 


optimization  procedure  described  in  section  2.2.  Here  we  present  the 
main  steps  of  the  derivation.  For  y.  *  0,  we  have 


x  =  Ax  +  CDz  +  w^ 
z  =  FEx  +  Az  +  Fw^ 

a  -  -  CDFEx  -  CDAz  +  Act  +  CDcr  -  CDFw. 
x  x  z  2 

CT  =  FEct  +  Act  -  CDFEx  -  CDAz  -  CDFw 
Z  X  z  2 


Define 


-CDFw2 

1CDFW2 


(6.45) 

(6.46) 

(6.47) 

(6.48) 


(6.49) 


(6.50) 


Hence  we  have  an  equivalent  static  minimization  problem  described  by 
equations  (2 .39)- (2 .40)  with  A,  Q  and  I!  as  defined  above.  The  necessary 
conditions  follow  directly  from  equations  (2 .41)-(2 .43)  with  one  more 
equation  ,  similar  to  equation  (2.41),  for  optimization  of  F. 


L 


Referring  to  section  2.2,  we  have,  in  this  case,  a  state 
equation  (2.23),  an  output  equation  (2.30)  and  an  observer  (2.25)  along 
with  a  performance  index  (2.33). 

The  equations  to  be  solved  are  summarized  as  follows: 


A'K  +  KA  +  Q  =  0 
AP  +  PA'  +2  =  0 

D  -  R  ^^22 
F  =  *22  (I*  +L5)  E"1 

ll  -  c'[e’f*(kp)42  -  (kp)12  -  (kp)34-  (kp)22  -  (KP)^] 

L4  -  1(KP)22  +  (kp)44  -  (KP)21  -  (KP)43+(KP)41A«  +  (KP)42D’C’ 
+  K41Z1JE* 


(6.51) 

(6.52) 

(6.53) 

(6.54) 

(6.55) 

(6.56) 

(6.57) 


where 


(6.58) 
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r 

i 


A 


CD 


0 


0 


A  = 


FE  A 


FEA  -FECD 


0  0 

A  CD  i 

FE  A  I 


Q 


0 


0 


0 


Q  - 


l 


0 

0 

0 


D'RD  0  0 

0  SO 

0  0  0 


0 


0 


.  0 


FS2F’ 


0 


£  = 


0 


0 


0 


-FEZj. 


0 


0 


I 


(6.61) 


(6.62) 


-EjE’F' 


0 


0 


FEEjE'F' 


(6.63) 


Pij’  Kij  anc*  (KP)^;  *->J  =1>2,3,4  are  partitions  of  P,  K  and  KP  as  in 
equations  (5.33)  -  (5.35). 


The  above  equations  are  obtained  directly  by  applying  the 


optimization  procedure  described  in  section  2.2.  Here  we  present  the 
main  steps  of  the  derivation.  For  M-  =  0,  we  have 
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Ax  +  CDz  +  w^ 

(6.64) 

FEx  +  Az  +  Fw£ 

(6.65) 

AC  +  CDa 

X  z 

(6.66) 

-  FEAx  -  FECDz  +  FEc  +  A a  ~  FEw, 

X  Z  1 

(6.67) 

Define 


x 


X  * 


(6.68) 


w 


-FEwl 


(6.69) 


Hence  we  have  an  equivalent  static  minimization  problem  described  by 
equations  (2 .39) -  (2 .40)  with  A,  Q  and  E  as  defined  above.  The  necessary 
conditions  follow  directly  from  equations  (2 .41) - (2 .43)  with  one  more 
equation  ,  similar  to  equation  (2.41),  for  optimization  of  f. 
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CHAPTER  7 

EXAMPLES 

In  this  chapter  we  apply  our  Low-sensitivity  design  scheme  to  two 
practical  examples  and  compare  the  results  to  those  of  the  standard  l£G 
design. 

7.1.  Continuous  Stirred-Tank  Reactor 

Consider  the  continuous  stirred-tank  reactor  [25]  illustrated  in 
Figure  7.1.  The  problem  is  to  control  the  outlet  temperature,  T,  and  the 
outlet  concentration,  at  some  desired  set  points,  T  and  CA,  in  such  a 
way  as  to  minimize  a  specified  cost  function.  The  manipulated  variables  are 
the  feed  rate,  w,  and  the  heat  added  or  removed,  Q.  In  practice  not  Q  but 
the  flow  rate  through  a  jacket  or  cooling  coils  would  be  manipulated.  This 
is  related  to  Q  through  an  unsteady  state  energy  balance.  For  this  problem 
however  it  is  simpler  to  assume  Q  is  directly  manipulated  and  that  enough 
heat  transfer  is  available  so  that  saturation  does  not  occur.  If  R  is 
chosen  relatively  large  this  will  assure  that  too  great  a  control  effort  will 
not  occur.  The  system  is  driven  by  the  initial  condition  given  for  temperature 
and  concentration.  This  is  the  standard  state  regulator  problem  and  physically 
may  be  interpreted  as  a  "start-up"  problem.  A  second  order  reversible  reaction 
is  assumed.  The  rate  of  reaction  is  expressed  by 

^A  2 

Rate  -  -£r  a-kCA  (7.1) 

The  rate  constant,  k,  may  be  expressed  as  a  function  of  temperature  using 


the  Arrhenius  expression 
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k  -  kQ  exp(- 

Substitution  of  (7.2)  into  (7.1)  yields 


(7.2) 


Rate  =-kQ  exp[-  (7.3) 

Note  from  (7.3)  that  the  rate  of  reaction  is  nonlinear  with  respect  to 
temperature,  T,  and  concentration  in  tank,  C^.  The  degree  of  nonlinearity 
with  respect  to  T  depends  on  the  size  of  a,  which  is  a  function  of  the 
particular  reaction.  Unsteady  state  material  and  energy  balances  on  the 
reactor  yield 


$P(cAf  '  V  '  k  ca 


dC 


_A 

dt 


(Tf  '  T)  +  ^ 


AHkCT 
_ A 

PC 


dT 

dt 


(7.4) 

(7.5) 


Linerarization  of  equations  (7.4)  and  (7.5)  about  steady  state 
or  set-point  conditions  yields 


A 

/ - 2  \ 

1 

w  2C. k  ' 

_  A 

CA  . 

,k*V 

-  I 

vp  J 

1 

lx2  1 

T  +  1 

w 


A 

dT 

dt 


-2  AHkCA  \ 

A 

CA  I 

j  w 

AHkC.al 
A  1 

A  Q  j 

Hi 

Hi 

1 

HI 

PCP  j 

^  vp  + 

T2  j 

T  +  vPCp  +  ' 

^  vp 

w 


(7.6) 


(7.7) 


and  T,  Q,  w  are  defined  as  variations  about  the  steady  state  values, 
CA  and  T,  Q,  w.  w  and  k  are  obtained  from  the  steady  state  versions  of 

A  A 

(7.4)  and  (7.5).  Defining  T  and  CA  as  our  state  variables  and  Q  and  w 
as  manipulated  variables  we  may  write 
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Using  the  above  parameters  our  system  equation  (7.8)  becomes 


—— 

— 

— — 

— 

0.041 

44. 6 

0.001 

-0.136 

X  * 

^0.001 

-0.307 

X  + 

0 

0.001 

(7.9) 


For  the  state  regulator  design  of  this  reactor,  we  should  expect 
an  undesirable  time  delay  in  measuring  the  system  states,  i.e.  temperature 
and  concentration.  Such  a  delay  might  be  significant  enough  to  affect  the 
system  behavior  causing  deviation  of  the  trajectories  from  the  nominal  ones, 
corresponding  to  zero  delays.  To  reduce  that  effect,  our  proposed  low- 
sensitivity  design  scheme  is  applied.  Consider  the  case  discussed  in  section 
4.1  using  the  following  design  parameters 


(7.10) 


Q  - 


1 

10 


10 

400 


(7.11) 


S  =  0 


(7.12) 


This  case  corresponds  to  the  standard  state  regulator  problem.  The 
feedback  gain  matrix  is  computed  to  be 


D 


-0.996 

0.76 


-103 

75.7 


(7.13) 


Trajectories  of  this  case  are  plotted  for  several  values  of  delays  as  well 
as  for  the  nominal  zero  delay.  Trajectories  and  controls  are  illustrated  in 
Figures  7. 2-7. 5.  It  is  seen  that  x2(t)  shows  unacceptable  sensitivity.  So, 
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we  choose  S  so  as  to  penalize  that  sensitivity.  Now,  consider  the  same 
values  of  R  and  Q  given  by  equations  (7.10)  -  (7.11)  along  with  the 
following  values  of  S 


S  = 


— t 

0 

100 


(7.14) 


The  feedback  gain  matrix  in  this  case  is 


D 


-0.997 

0.532 


-105.1 


-53.21 


(7.15) 


The  trajectories  x^(t)  and  X£(t)  of  this  case  are  illustrated  in  Figures 
7.6  and  7.7  respectively.  The  controls  u^(t)  and  u^t)  are  illustrated  in 
Figures  7.8  and  7.9  respectively.  It  is  seen  that  trajectories  in  this  case 
become  closer  to  each  other  than  they  are  for  the  case  when  S=0  (Figures 
7.2  and  7.3).  This  means  that  sensitivity  to  small  undesirable  delays  is 
reduced.  However,  we  notice  that  the  trajectories  have  large  overshoots. 

To  improve  this  undesirable  transient  phenomena,  we  try  other  values  of  the 
design  matrices  Q,  R  and  S.  A  good  choice  of  Q,  R  and  S  will  result  in  low 
sensitive  trajectories  having  desirable  transient  phenomena. 


For  another  set  of  trajectories,  consider  the  following 


Q  = 


0.1 

0 

0 

1 

50 

10 

10 

400 

1 

0 

0 

10 

(7.16) 


(7.17) 


(7.18) 
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Trajectories  and  controls  of  this  case  are  illustrated  in  Figures  7.12-7.15. 

From  the  above  discussion  and  associated  plots  we  conclude  that 
our  design  scheme  is  reliable  in  reducing  trajectory  sensitivity.  This  is 
because  the  matrix  S  has  a  direct  handle  on  the  trajectory  sensitivity  with 
any  desired  weighting.  To  get  acceptable  trajectories,  several  values  of  Q, 

R  and  S  have  been  tried.  It  is  seen  that  the  choice  of  Q,  R  and  S  given  by 
equations  (7.17),  (7.16)  and  (7.20)  respectively  has  resulted  in  a  satisfactorily 
low  sensitivity.  However,  the  transient  response  is  not  satisfactory.  The 
choice  given  by  equations  (7.10),  (7.11)  and  (7.14)  showed  satisfactory 
sensitivity  as  well  as  satisfactory  transient  phenomena.  So,  that  would  be 
the  recommended  choice  for  this  design. 
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Figure  7.3.  x2(t)  for  R,Q  and  S  given  by  equations  (7.10),  (7.11) 

and  (7.12) 
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Figure  7.7.  x2(t)  for  R,Q  and  S  given  by  equations  (7.10),  (7.11) 

and  (7.14) 
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Figure  7.10.  x^(t)  for  R,Q  and  S  given  by  equations  (7.16),  (7.17) 

and  (7.18) 


1  l 
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r 

28  38 

for  R,Q  and  S  given  by  equations  (7.16),  (7.17) 
.18) 
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Figure  7.12.  x^(t)  for  R,Q  and  S  given  by  equations  (7.16),  (7.17) 

and  (7.20) 


7.2.  F100  Turbofan  Engine 


Consider  the  Pratt  &  Whitney  F100-PW-100  afterburning  turbofan, 
a  low-bypass-  ratio,  twin-spool,  axial-flow  engine.  An  extensive  set  of 
linear  state  descriptions  of  this  engine  were  given  by  Miller  and  Hackney  [26] . 
The  engine  is  described  by  a  sixteenth  order  state  model  at  20  operating 
points.  That  model  is  for  zero  altitude  and  for  a  power  level  angle  (PLA)  of 
67  degrees  which  is  near  maximum  non-afterburning  power.  Such  an  operating 
point  is  chosen  because  every  engine  has  to  pass  through  this  condition  as, 
for  example,  -n  takeoff.  The  engine  state  variables  are  defined  as  follows 

X^  =  Fan  Speed,  SNFAN  (N^)  -  rpm 

X2  *  Compressor  Speed,  SNCOM  (Nj)  -  rpm 

X^  *  Compressor  Discharge  Pressure,  -  psia 

X^  *=  Interturbine  Volume  Pressure,  P^  ^  -  psia 

X^  •  Augmentor  Pressure,  Pt2m  -  psia 

Xg  =  Fan  Inside  Diameter  Discharge  Temperature,  T^  ^  -  °R 

Xy  =  Duct  Temperature,  T^  ^  -  °R 

Xg  =  Compressor  Discharge  Temperature,  T^  -  °R 

Xg  »  Burner  Exit  Fast  Response  Temperature,  T^^  “  °R 

X10  *  Burner  Exit  Slow  Response  Temperature,  Tt^Q  “  °R 

XU  *  Burner  Exit  Total  Temperature,  Tt4  -  9r 

X12  *  Fan  Turbine  In^-et  Fast  Response  Temperature,  T^  ^hi  “  °R 

X13  *  Fan  Turb*-ne  lnlet  Slow  Response  Temperature,  T^  -  °R 

xi4  “  Fan  Turbine  Exit  Temperature,  T^  -  °R 

X15  *  ^ucC  Exit  Temperature,  Ttgc  -  °R 
X16  "  Duct  Exic  Temperature,  Tt7m‘°R 


The  inputs  are  defined  as  follows 


=  Main  Burner  Fuel  Flow,  WFMB  -  lb/hr 

2 

U2  *  Nozzle  Jet  Area,  -  ft 

U3  *  Inlet  Guide  Vane  Position,  CIW  -  deg 

=  High  Variable  Stator  Position,  RCW  -  deg 
*  Customer  Compressor  Bleed  Flow,  BLC  -  % 

The  outputs  are  defined  as  follows 

Y^  =  Engine  Net  Thrust  Level,  FN  -  lb 
Yj  “  Total  Engine  Airflow,  WFAN  -  lb/sec 
Y^  =  Turbine  Inlet  Temperature,  T^  -  °R 
Y^  «  Fan  Stall  Margin,  SMAF 
Y5  =  Compressor  Stall  Margin,  SMHC 

The  sixteen  eigenvalues  of  the  engine  were  determined  to  be  approximately: 
-577,  -175,  -58,  -51,  -48,  -39,  -21.4  +  j0.9,  -18.6,  -17.8  +  J4.2,  -5.8  +  J5, 
-3.8,  -2,  -.68. 

A  reduced  order  plant  was  obtained  [26]  by  eliminating  all  eigen¬ 
values  beyond  the  frequency  range  of  interest,  namely  all  real  parts  less 
than  -17.8.  This  gave  a  fifth  order  model.  However  since  the  fan  turbine 
inlet  temperature  (FTIT)  is  a  sensed  variable,  the  fast  response  eigenvalue 
of  FTIT  (-51)  was  also  included.  A  sixth  order  reduced  engine  model  was 
established  with  eigenvalues  and  state  variable  correspondence  as  follows 

-.68  -T41  ,  Burner  Exit  Slow  Response  (x^) 

-2.0  -T^  5^0>  Fan  Turbine  Inlet  Slow  Response  (x^) 

-4.06  -Njj  Compressor  Speed  (x^) 
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-5.4  +  4.71  Np  Fan  Speed  (x^) 


-5.4- 4. 7i  Augmentor  Pressure  (x^) 

-51  Fan  Turbine  Inlet  Fast  Response  (x^) 

All  of  the  sensed  variables,  except  compressor  discharge  pressure,  appear 
in  the  reduced  model.  Four  inputs  and  four  outputs  are  considered  in  that 
model.  The  inputs  are  defined  as  follows 


u^  =  WF,  Fuel  Flow,  PFH 

2 

U2  =  AJ,  exhaust  nozzle  area,  FT 
u^  =  CIW,  inlet  vane  position,  DEG 
u^  =  RCW,  compressor  vane  position,  DEG 

The  outputs  are  defined  as  follows 


*  Nl,  fan  speed,  RPM 

y2  =  N2’  cotnPressor  sPeed,  RPM 
=  Py,  augmentor  pressure,  PSI 
y^  =  FTIT,  fan  turbine  inlet  temperature,  °F. 


The  parameter  matrices 


-4.064 

3.895 

.03718 

-2.958 

.03389 

.0067 

1.164 

-2.646 

.05174 

-.1176 

. 00184 

.0036 

A,  C  and  E  are  given 


-470.5 

7.971 

-59.13 

.1727 

-4.442 

.0059 

-331.6 

-50.05 

-14.74 

-2.001 

-.601 

. 00008 

[27]  as  follows 


5.294 

-3.005 

2.08 

12.48 

.1474 

.0985 

-.473 

-11.36 

-2.021 

-.505 

.0009 

-.666 

(7.22) 


♦ 


f 


r 
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.8686 

-14.51 

-96.14 

9.246 

.9096 

-58.46 

-1.053 

-60.15 

-.007994 

-79.66 

1.2 

.3673 

5.643 

-112.2 

-18.23 

41.53 

.2508 

-4.99 

-.8106 

1.846 

-.3166 

-.02915 

.07426 

1  0 

0 

0 

0 

0 

0  1 

0 

0 

0 

0 

E  = 

0  0 

1 

0 

0 

0 

0  0 

0 

1 

1 

0 

(7.23) 


(7.24) 


Consider  the  problem  of  controlling  the  above  reduced  sixth  order 
model,  using  an  output  feedback  control  law  so  as  to  minimize  a  quadratic 
performance  index.  To  implement  such  a  feedback  control  a  time  delay  may  be 
expected  due  to  the  measurement  of  the  output  variables.  Preliminary 
analysis  of  this  example  has  shown  overshoots  in  the  trajectories  of  x^  and 
x2  at  t  =  0.005.  So,  we  expect  a  time  delay  of  this  order  of  magnitude  to 
have  a  significant  effect  on  the  system  trajectories.  It  has  been  seen  that 
delays  of  the  order  of  10”4  result  in  a  significant  deviation  of  the  trajec¬ 
tories  from  the  nominal  ones.  Larger  delays  result  in  completely  destabiliz¬ 
ing  the  system.  To  reduce  that  effect  we  apply  the  design  strategy  described 
in  Section  4.2. 

Consider  the  following  parameters 

R  =  iO4  (7.25) 

Q  =  l6  (7v26) 
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S  *  0 


(7.27) 


The  feedback  gain  matrix  is 


-.82x10“ 6 

-.26xl0“5 

.58xl0'4 

. 76xl0~7 

-.15xl0'2 

-.61x10“ 3 

. 83xl0-1 

. 63x10  4 

.74xl0"4 

.21xl0"5 

- . 3xlO-2 

. 14xl0"4 

10xl0'4 

. 17xl0“3 

- . llxlO-2 

- ,21xl0“4 

(7.28) 


Two  values  of  ^  are  simulated  in  addition  to  the  nominal  value,  i.e.  zero. 
The  state  trajectories  are  illustrated  in  Figures  7.16-7.21.  It  is  seen  that 
the  first  three  state  trajectories  show  high  sensitivity.  So,  we  choose  S 
with  suitable  entries  so  as  to  penalize  their  sensitivities  more  than  the 
other  three. 

Now,  consider  the  same  values  of  R  and  Q  given  by  equations  (7.25) 
and  (7.26)  along  with  the  following  value  of  S: 


S  =  diag [ 100,  100,  100,  10,  10,  10] 


The  feedback  gain  matrix  in  this  case  is 


(7.29) 


- . 76x10 


-.21x10 


.54x10 


-.21x10 


-. 68x10 


,  11x10 


.38x10 


,87x10* 


-.36x10 


.69x10 


.57x10 


.11x10 


(7.30) 


-.20x10 


. 14x10 


-.10x10 


-.19x10 


The  state  trajectories  illustrated  in  Figures  7.22  -  7.27.  The  nominal 
trajectories  of  this  case  are  illustrated  on  a  wider  horizon  in  Figures 
7.28  -  7.33  to  demonstrate  the  stability  of  the  system. 

In  order  to  obtain  more  satisfactory  sensitivity  consider  the  same 
values  of  R  and  Q  given  by  equations  (7.25)  and  (7.26)  along  with  the  follow- 
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ing  values  of  S 


S  *  [1000,  1000,  1000,  100,  100,  100] 
The  feedback  gain  matrix  in  this  case  is 


(7.31) 


-.73xl0"6 

llxlO-3 

.2 lxlQ-4 

. 60x10  2 

-.23xl0"2 

-.68xlO-3 

,88xl0-1 

.51xl0-4 

.49xl0'4 

. llxlO"5 

-.38xl0-2 

.  llxlO-4 

-.23xl0‘4 

. 13xl0-3 

- . 10xl0~2 

- . lOxlO-4 

The  state  trajectories  are  illustrated  in  Figures  7.34-7.39. 

From  the  plots  associated  with  the  above  cases,  we  see  that 
sensitivity  to  small  time  delays  is  reduced  due  to  our  proposed  design 
strategy.  We  notice  a  significant  improvement  insensitivity  of  the  first  3 
state  trajectories  that  were  penalized  the  most.  It  is  observed  in  this  example 
that  increasing  S  is  reflected  directly  on  the  sensitivity  reduction  of  the 
different  state  trajectories.  The  choice  of  S  givenby  equation  (7.31)  has  shown 
satisfactory  sensitivity  for  all  of  the  six  states  as  well  as  ' r,  acceptable  transient 
phenomena.  The  choice  of Q  is  kept  unchanged  in  each  trial  of  the  values  of  S 
because  the  resulting  transient  phenomena  was  acceptable.  In  fact  it  is  improved 
for  some  trajectories.  For  example,  X2(t)  illustrated  in  Figure  7.35  shows  an 
amount  of  undershoot  which  is  less  than  that  shown  in  Figure  7.23  which,  in  turn  is 
less  chan  the  one  shown  in  Figure  7.17.  The  feedback  gain  matrices  given  by 
equations  (7.28),  (7.30)  and  (7.32)  have  norms  which  are  approximately  equal 
which  means  that  not  much  increase  in  the  control  effort  is  needed.  So,  the 
choice  of  R  is  unchanged  with  the  different  trials  of  S. 
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Figure  7.25.  x^(t)  for  S  given  bv  equation  (7.29) 
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Figure  7.34.  x^(t)  for  S  given  by  equation  (7.31) 
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Figure  7.36.  x^(t)  for  S  given  by  equation  (7.31) 
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CHAPTER  8 

SUMMARY  AND  CONCLUSIONS 

The  work  in  this  thesis  is  an  addition  to  the  study  of  trajectory 
sensitivity  of  optimal  control  systems.  The  parameter  with  respect  to 
which  sensitivity  is  studied  is  a  small  undesirable  time  delay  that  might 
cccur  in  a  system  designed  nominally  with  zero  delays.  If  the  standard 
linear  regulator  problem  is  used,  trajectories  may  show  unsatisfactory  sensitivi¬ 
ties  to  small  time  delays .  This  might  be  handled  by  adjusting  the  design  para¬ 
meters  Q  and  R.  But  that  approach  may  not  be  convenient  because  of  the  lack 
of  a  direct  theoretical  basis  for  adjusting  Q  and  R.  In  order  to  provide  a 
direct  handle  on  the  sensitivity  a  design  strategy  is  proposed  in  which  a 
quadratic  performance  index  which  includes  a  sensitivity  measure  is  minimized. 
This  sensitivity  measure  is  a  quadratic  term  of  the  sensitivity  functions,  de¬ 
fined  by  (2.13),  with  some  weighting  matrix  S.  Q,  R  and  S  can  be  adjusted 
together  to  get  a  desirable  behavior.  Q  penalizes  state  trajectories,  R 
penalizes  the  control  and  S  penalizes  trajectory  sensitivity.  Necessary  condi¬ 
tions  of  optimality  are  derived  for  all  possibilities  of  delay  occurrence. 
Existence  of  an  optimal  control  is  investigated  and  it  is  proved  that  it  exists 
for  small  values  of  S.  However,  this  is  only  a  sufficient  condition.  In 
Chapter  7,  it  has  been  seen  numerically  that  such  a  control  exists  even  for 
relatively  large  values  of  S.  Numerical  algorithms  are  presented  to  solve  the 
resulting  necessary  conditions  of  optimality.  Convergence  of  such  algorithms 
is  investigated.  These  algorithms  are  shown  to  move  in  a  downhill  direction. 

In  other  words,  the  performance  index  is  decreased  in  each  iteration.  Analytical 
proof  for  convergence  is  provided  for  subiterations  within  these  algorithms. 


The  proposed  design  strategy  is  applied  to  a  continuous  stirred-tank 
reactor  and  a  sixth  order  nscdel  of  the  F100  turbofan  engine.  It  has  been 
seen  that  the  numerical  algorithms  work  efficiently.  Several  values  of  Q,  R, 
and  S  are  tried.  It  has  been  seen  that  the  choice  of  S  with  a  specific 
weigh c mg  is  ret'Lected  directly  on  the  sensitivity  of  the  different  state 
trajectories.  This  direct  handle  on  sensitivity  is  the  main  advantage  of 
;.-.;s  p r  o*  srj  sene me.  In  both  examples  suitable  values  of  Q,  R  and 

*  .  .  «•  >.  ream  trajectories  with  acceptable  transient  phenomena 
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